Methods and apparatus for assessing network presence

ABSTRACT

Methods and apparatus for assessing network presence. In an embodiment, a method is provided for determining a presence score. The method includes transmitting a quick response (QR) code and a sound signal, receiving an image of the QR code and a sound clip of the sound signal, and determining a presence score associated with a user device based on at least one of a comparison of the QR code to the image of the QR code and a comparison of the sound signal to the sound clip.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application contains subject matter which may be related tothe subject matter in U.S. patent application Ser. No. 17/151,106entitled “METHODS AND APPARATUS FOR ESTABLISHING NETWORK PRESENCE” filedon Jan. 15, 2021 and assigned to the assignee of the present application

FIELD

The exemplary embodiments of the present invention relate to the fieldof network communication. More specifically, the exemplary embodimentsof the present invention relate to determining network presence.

BACKGROUND

With the increasing popularity of digital electronics and networkcommunications, real-time interactive network conferences (or meetings)have become more popular. For example, network conferencing applicationsnow allow people to communicate with each other from remote locations toexchange audio and video in real time.

During a network conference, each meeting attendee can transmit videoand audio signals to other attendees. A typical conferencing device isconfigured with a camera that captures an image of a conference attendeeand a microphone that captures the attendee's voice. Unfortunately, itmay be possible for a recorded image or voice to be substituted for thereal-time interactions of a conference attendee. It is also possible toreplace the real-time user interactions when accessing other types ofnetwork services. Thus, it is desirable to have a mechanism to determinenetwork presence, which indicates the probability that the interactionsof a user device are from a real person and not a recording or othersimulation.

SUMMARY

In various embodiments, methods and apparatus are disclosed forreal-time presence assessment, establishment, and monitoring. In anembodiment, when a user device requests to access network services, aserver performs a presence assessment operation that determines apresence score. The presence score indicates the probability that theuser device is providing interactions from an actual person and not arobot, simulation, or pre-stored information. In an embodiment, theserver transmits a quick response (QR) code and a generated sound signalto a secondary device associated with the user of the user device. Forexample, the secondary device can be a smartphone associated with theuser. The user positions the secondary device so that a camera of theuser device can capture an image of the QR code displayed on a displayscreen of the secondary device. The microphone of the user devicecaptures a sound clip of the sound signal reproduced by the secondarydevice.

The captured image and sound signal are transmitted to the server alongwith a resource identifier that identifies the resources in use at theuser device. The server generates a presence score by comparing thetransmitted QR code and sound signal with the captured versions receivedfrom the user device. In an embodiment, an application at the userdevice monitors the resources being utilized, and if a change isdetected, an updated resource identifier is generated and transmitted tothe server. The server then updates the presence score. In anotherembodiment, a video puzzle is used instead of a QR code. For example, anAR CAPTCHA puzzle is transmitted to the user device or the secondarydevice. The user solves the puzzle and transmits the solution to theserver, which determines the resulting presence score.

In an embodiment, a method is provided for determining a presence score.The method includes transmitting a quick response (QR) code and a soundsignal, receiving an image of the QR code and a sound clip of the soundsignal, and determining a presence score associated with a user devicebased on at least one of a comparison of the QR code to the image of theQR code and a comparison of the sound signal to the sound clip.

In an embodiment, apparatus is provided for determining a presencescore. The apparatus comprises a transceiver configured to transmit aquick response (QR) code and a sound signal, and receive an image of theQR code and a sound clip of the sound signal. The apparatus alsocomprises a processor configured to determine a presence scoreassociated with a user device based on at least one of a comparison ofthe QR code to the image of the QR code and a comparison of the soundsignal to the sound clip.

In an embodiment, a non-transitory computer readable medium is providedon which are stored program instructions that, when executed by one ormore processors, cause the one or more processors to determine apresence score by performing operations of: transmitting a quickresponse (QR) code and a sound signal; receiving an image of the QR codeand a sound clip of the sound signal; and determining a presence scoreassociated with a user device based on at least one of a comparison ofthe QR code to the image of the QR code and a comparison of the soundsignal to the sound clip.

Additional features and benefits of the exemplary embodiments of thepresent invention will become apparent from the detailed description,figures and claims set forth below.

BRIEF DESCRIPTION OF THE DRAWINGS

The exemplary embodiments of the present invention will be understoodmore fully from the detailed description given below and from theaccompanying drawings of various embodiments of the invention, which,however, should not be taken to limit the invention to the specificembodiments, but are for explanation and understanding only.

FIG. 1 shows a diagram of a communication network that illustratesembodiments of real-time presence assessment.

FIG. 2 shows an exemplary user device configured to provide embodimentsof real-time presence assessment.

FIG. 3 shows an exemplary server configured to provide embodiments ofreal-time presence assessment.

FIG. 4 shows an exemplary embodiment of the presence scoring circuitshown in FIG. 3.

FIG. 5 shows an exemplary method for operating a user device to provideembodiments of real-time presence assessment.

FIG. 6 shows an exemplary method for operating a server to provideembodiments of real-time presence assessment.

FIG. 7 shows an alternative embodiment for using a secondary device toperform real-time presence assessment.

FIG. 8 shows an exemplary method for operating a server to provideembodiments of real-time presence assessment.

FIG. 9 shows an exemplary method for operating a user device to provideembodiments of real-time presence assessment.

DETAILED DESCRIPTION

Embodiments of the present invention disclose systems, methods, andapparatus for providing real-time presence assessment and monitoring.

The purpose of the following detailed description is to provide anunderstanding of one or more embodiments of the present invention. Thoseof ordinary skills in the art will realize that the following detaileddescription is illustrative only and is not intended to be in any waylimiting. Other embodiments will readily suggest themselves to suchskilled persons having the benefit of this disclosure and/ordescription.

In the interest of clarity, not all of the routine features of theimplementations described herein are shown and described. It will, ofcourse, be understood that in the development of any such actualimplementation, numerous implementation-specific decisions may be madein order to achieve the developer's specific goals, such as compliancewith application and business related constraints, and that thesespecific goals will vary from one implementation to another and from onedeveloper to another. Moreover, it will be understood that such adevelopment effort might be complex and time-consuming but wouldnevertheless be a routine undertaking of engineering for those ofordinary skills in the art having the benefit of embodiments of thisdisclosure.

Various embodiments of the present invention illustrated in the drawingsmay not be drawn to scale. Rather, the dimensions of the variousfeatures may be expanded or reduced for clarity. In addition, some ofthe drawings may be simplified for clarity. Thus, the drawings may notdepict all of the components of a given apparatus (e.g., device) ormethod. The same reference indicators will be used throughout thedrawings and the following detailed description to refer to the same orlike parts.

In accordance with the embodiments of the present invention, thecomponents, process steps, and/or data structures described herein maybe implemented using various types of operating systems, computingplatforms, computer programs, and/or general-purpose machines. Inaddition, those of ordinary skills in the art will recognize thatdevices of a less general-purpose nature, such as hardware devices,field programmable gate arrays (FPGAs), application specific integratedcircuits (ASICs), or the like, may also be used without departing fromthe scope and spirit of the inventive concepts disclosed herein. Where amethod comprising a series of process steps is implemented by a computeror a machine, those process steps can be stored as a series ofinstructions readable by the machine or computer for execution. Theinstructions may be stored on a tangible medium such as, but not limitedto, magnetoresistive random access memory (“MRAM”), phase-change memory,or ferroelectric RAM (“FeRAM”), flash memory, ROM (Read Only Memory),PROM (Programmable Read Only Memory), EEPROM (Electrically ErasableProgrammable Read Only Memory), Jump Drive, magnetic storage medium(e.g., tape, magnetic disk drive, and the like), optical storage medium(e.g., CD-ROM, DVD-ROM, paper card and paper tape, and the like) andother known types of program memory.

The term “system” or “device” is used generically herein to describe anynumber of components, elements, sub-systems, devices, packet switchelements, packet switches, access switches, routers, networks, computerand/or communication devices or mechanisms, or combinations ofcomponents thereof. The term “computer” includes a processor, memory,and buses capable of executing instructions and refers to one or acluster of computers, personal computers, workstations, mainframes, orcombinations of computing devices thereof.

FIG. 1 shows a diagram of a communication network 100 that illustratesembodiments of real-time presence assessment. The communication network100 comprises a user device 102, system server 104, communicationnetwork 106, cellular network 108, and smartphone 110. In an embodiment,the system server 104 executes a real-time presence assessmentapplication (PPA) 114, and the user device 102 executes a real-timepresence monitoring application (PMA 112), which operate together todetermine real-time presence assessments. It should be noted that theuser device 102 comprises any device or user equipment, such as adesktop computer, laptop, notebook, tablet, smartphone or any other typeof device suitable to perform the operations of the embodimentsdisclosed herein.

During operation, the user device 102 transmits a request (1) to theserver 104 to initiate or join a conference or perform some other remotefunction. The server 104 responds to the request (1) by transmitting aninstruction (2) to the user device 102 to initiate a presenceassessment. The server 104 then transmit a QR code and sound signal(collectively shown at (3)), to the smartphone 110. The transmission isperformed using the network 106 and the cellular network 108. In anembodiment, the smartphone 100 is associated with the user of the userdevice 102.

The smartphone 110 displays an image of the QR code (4) on a displayscreen and reproduces the sound signal as a tone (5) emanating from aspeaker within the smartphone 110. The user of the user device 102 holdsthe smartphone 110 up to a camera of the user device 102 so that thecamera can capture the image of the QR code (4) displayed on thesmartphone display screen. The user also holds the smartphone close to amicrophone of the user device 102 so that the microphone can capture asound clip of the tone (5) being reproduced by the speaker of thesmartphone.

The user device 102 transmits the captured image of the QR code (6) andthe captured sound clip (7) to the server 104. The PMA 112 alsotransmits a resource identifier (8) to the server 104. The resourceidentifier identifies resources, such as the camera and microphoneresources, currently in use at the user device 102.

At the server 104, the PAA 114 receives the image (6), sound clip (7),and resource identifier (8) and determines a presence score (9) thatindicates the probability that an actual person at the user device 102is interacting with the serve 104 in real-time. For example, a highpresence score indicates that an actual person is interacting with theserver, and a low presence score indicates that a robot, simulation, orpre-stored information is being used to interact with the server. ThePAA 114 transmits the determined presence score to back to the userdevice 102. The requested conference or other function can be conductedwhen the presence score exceeds a selected threshold. For example, ifthe presence score is greater than 90%, the requested function will beperformed. If the presence score is below the threshold, the requestfrom the user to perform the network function is denied.

The PMA 112 also monitors the operation of the user device 102 todetermine if there is a change to the resources used for the conferenceor remote function. For example, a change in resources, such as a changein the camera or microphone, may indicate the user is no longerinteracting in real-time. When a change in resources occurs, the PMA 112transmits an updated resource identifier (8) to the server thatidentifies the new resources. The PMA 114 updates the presence score (9)based on the updated resources and determines whether or not theconference or other network function can continue. The presence scorecan also be stored or logged for later use.

In various exemplary embodiments, the user device 102 and the server 104provide real-time presence assessment by performing one or more of thefollowing operations.

1. A user of user device 102 transmits request (1) to initiate or join aconference or perform some other function using remote participation.

2. The server 104 initiates (2) real time presence scoring to determinethe probability that an actual user is interacting with the server inreal time.

3. The server transmits a QR code and sound signal (tone) to a secondarydevice associated with the user of the user device 102. The secondarydevice displays the QR code (4) and reproduces the tone (5)

4. The user of the user device 102 holds secondary device to a cameraand microphone of the user device so that the camera can capture theimage of the QR code (4) and the microphone can capture a sound clip ofthe tone (5).

6. The user device transmits the captured image of the QR code and thesound clip to the server, as indicate at (6) and (7).

7. The user device transmits a resource identifier (8) that identifiesresources utilized at the user device.

8. The server determines a presence score (9) based on the capture image(6), sound clip (7), and resource identifier (8). If the presence scoreis greater than a threshold value, the user request (1) will be granted.If the presence score is not greater than a threshold value, the userrequest (1) will be denied.

9. Assuming the request is granted, the user device monitors resourceusage and transmits an updated resource identifier (8) if the resourcesutilized at the user device change.

10. The server updates the presence score to reflect the change in theresources at the user device. If the updated presence score is greaterthan a threshold value, the user participation in the requested functionwill be allowed to continue. If the presence score is not greater than athreshold value, the user participation in the requested function willbe terminated.

Thus, embodiments of real-time presence assessment are provided by theserver 104 executing the PAA 114 and the user device 102 executing thePMA 112. More detailed descriptions of the various implementations andoperations of the server 104 and the user device 102 to providereal-time presence assessment are provided below.

FIG. 2 shows an exemplary user device 200 configured to provideembodiments of real-time presence assessment. For example, the userdevice 200 is suitable for use as the user device 102 shown in FIG. 1.The user device 200 comprises processor 202, memory 204,camera/microphone interface 206, display/sound interface 208,instruction memory 210, and transceiver 212 all connected to communicateover data bus 214. In an embodiment, the instruction memory 210comprises presence monitoring application 216.

During operation, the processor 202 executes the presence monitoringapplication 216 to perform the functions and operations of the userdevice described herein. For example, the processor 202 controls thecamera/mic interface 206 to receive camera/microphone signals 220 from acamera and microphone mounted at the user device. The display/soundinterface 208 is configured to output video/sound signals 218 to a videodisplay and sound reproduction speaker that are part of the user device.

The processor 202 also receives user input 222 and responds to thisinput to perform various functions of the user device. The transceiver212 is controlled by the processor 202 to transmit and receiveinformation over communication networks. For example, transceiver 212 isconfigured to transmit and receive information over the networks 106 and108 shown in FIG. 1.

In an embodiment, the processor 202 controls the transceiver 212 totransmit a conference request signal 224 to a conference server, such asthe system server 104 shown in FIG. 1. As part of the request 224, theprocessor 202 includes information identifying the user device, theconference to be joined, and a secondary device accessible by the userof the user device 200. For example, the secondary device can be thesmartphone 110 shown in FIG. 1.

In response to the request 224, the server 104 responds with a commandto initiate presence scoring 226 that is received by the transceiver 212and passed to the processor 202. The server 104 then generates andtransmits a QR code to the secondary device. The server 104 alsogenerates and transmits a sound signal to the secondary device. In anembodiment, the sound signal is dynamically generated or derived fromthe generated QR code. Upon receiving the QR code and the sound signal,the secondary device displays the QR code on a display screen of thesecondary device and reproduces the received sound signal as an audiblesound signal.

In response to the initiate command 226, the processor 202 instructs theuser of the user device 200 to hold the secondary device up to thecamera of the user device so that the image of the QR code on thedisplay of the secondary device can be captured by the camera of theuser device. For example, the processor 202 outputs instructions thatare displayed to the user on the display screen of the user device. Theprocessor 202 also instructs the user of the user device 200 to hold thesecondary device up to the microphone of the user device so that theaudible sound reproduced by the secondary device can be captured as asound clip by the microphone of the user device. Thus, the camera imageof the displayed QR code on the secondary device is received by thecamera/microphone interface 206 and passed to the processor 202. Thetone reproduced by a speaker of the secondary device is captured as asound clip by the microphone of the user device. This sound clip isreceived by the camera/microphone interface 206 and passed to theprocessor 202.

The processor 220 controls the transceiver 212 to transmit the capturedimage and/or sound as a response 228 to the server. The processor 202also controls the transceiver to transmit a resource identifier 230 thatidentifies the camera and microphone resources in use by the userdevice. The server uses the information transmitted by the user deviceto determine a presence score (0-100%) that indicates the probabilitythat the user of the user device is a real person in actual real-timecommunication with the server. The presence score 232 is received by thetransceiver 212 and passed to the processor 202. The processor 202 thensaves and/or displays the presence score to the user of the user device.If the presence score is greater than a threshold value (e.g., 90%), therequest 224 is granted. If the presence score is not greater than athreshold value, the request 224 is denied.

In an embodiment, the processor 202 executes the application 216 tomonitor the resources used by the user device. For example, theprocessor 202 monitors the camera and microphone resources to determineif the resources that are being used have changed since the lastresource identifier 230 was transmitted. A resource change, such as achange in the camera or microphone, may indicate that the user is not inactual real-time communication with the server. For example, a livevideo feed from the camera of the user device may be replaced with avideo file that is being substituted for the live feed. When theprocessor 202 detects a change in the resources in use, the processor202 generates an updated resource identifier 230 and transmits thisupdated indicator to the server. The server, then generates an updatedpresence score 232 that is transmitted back to the user device.

In various exemplary embodiments, the processor 202 executes theapplication 216 to perform the functions and operations of the userdevice 200. In an exemplary embodiment, the user device 200 performs atleast the following operations to provide embodiments of real-timepresence assessment.

1. The user device transmits a conference request 224 to a networkserver to join or host a network conference or to perform some otherremote function. The request identifies the user device, a conference(or function) identifier, and a secondary device.

2. The user device receives an initiate presence scoring command 226from the network server. The network server also generates a QR code andsound signal that is transmitted to the secondary device.

3. The user device instructs the user to position the secondary deviceso that a camera and microphone of the user device can capture an imageof the QR code and an audible sound signal reproduced by the secondarydevice.

4. The user device transmits the capture image and/or sound response 228to the server. The user device also transmits a resource identifier 230that identifies the camera and microphone resources in use by the userdevice.

5. The user device receives a presence score from the server. If thepresence score is greater than a threshold value (e.g., 90%), therequest is granted. If the presence score is not greater than athreshold value, the request is denied.

6. The user device monitors the resources in use and if a change in theresources occurs, the user device transmits an updated resourceidentifier 230 to the server. The updated resource identifier 230results in an updated presence score 232

FIG. 3 shows an exemplary server 300 configured to provide embodimentsof real-time presence assessment. For example, the server 300 issuitable for use as the server 104 shown in FIG. 1. The server 300comprises processor 302, memory 304, presence scoring circuit 306,instruction memory 308, and transceiver 310 all connected to communicateover data bus 312. In an embodiment, the instruction memory 308comprises presence assessment application 314.

During operation, the processor 302 executes the application 314 toperform the functions and operations of the server described herein. Thetransceiver 310 is controlled by the processor 302 to transmit andreceive information over communication networks. For example,transceiver 310 is configured to transmit and receive information overthe networks 106 and 108 shown in FIG. 1.

In an embodiment, the processor 302 controls the transceiver 310 toreceive a conference request signal 318 from a user device, such as theuser device 102 shown in FIG. 1. The request 318, includes informationidentifying the user device, the conference to be joined, and asecondary device accessible by the user of the user device. For example,the secondary device can be the smartphone 110 shown in FIG. 1. In anembodiment, the request 318 identifies a function to be providedremotely to the user device.

In response to the request 318, the server 104 transmits a command toinitiate presence scoring 320 that is received by the user device. Theserver 300 then generates and transmits a QR code and a sound signal 322to the secondary device. In an embodiment, the sound signal isdynamically generated or derived from the generated QR code. Uponreceiving the QR code and the sound signal, the secondary devicedisplays the QR code on a display screen of the secondary device andreproduces the received sound signal as an audible tone.

In response to the initiate command 320, the user device positions thesecondary device so that a camera at the user device can capture animage of the QR code. A microphone at the user device captures the soundsignal reproduced by a speaker at the secondary device. The user devicetransmits the captured QR code and sound clip as an image and/or soundresponse 324 to the server 300. The user device also transmits aresource identifier 326 that is received by the transceiver 310 andpassed to the processor 302.

The processor 302 uses the information received from the user device todetermine a presence score (0-100%) that indicates the probability thatthe user of the user device is a real person in actual real-timecommunication with the server. In an embodiment, the processor 302controls the presence scoring circuit 306 to generate the presencescore. The processor 302 controls the transceiver 310 to transmit thepresence score 328 to the user device. In an embodiment, if the presencescore is greater than a threshold value (e.g., 90%), the request 318 isgranted. If the presence score is not greater than a threshold value,the request 318 is denied. A detailed description of the presencescoring circuit 306 is provided below.

In an embodiment, the processor 302 executes the application 314 toupdate the presence score 328 when the resources used by the user deviceare changed. For example, the processor 302 monitors the resourceidentifier 326 to determine if the resources that are being used at theuser device have changed since the last resource identifier 326 wasreceived. A resource change at the user device, such as a change in thecamera or microphone, may indicate that the user is not in actualreal-time communication with the server. For example, a live video feedfrom the camera of the user device may be replaced with a video filethat is being substituted for the live feed. When the processor 302detects a change in the resources in use at the user device based on anupdated resource identifier, the processor 302 controls the presencescoring circuit 306 to generate and updated presence score 328 that istransmitted to the user device. If the updated presence score fallsbelow the threshold, then the functions being performed for the user maybe terminated.

In various exemplary embodiments, the processor 302 executes theapplication 314 to perform the functions and operations of the server300. In an exemplary embodiment, the server 300 performs at least thefollowing operations to provide embodiments of real-time presenceassessment.

1. The server receives a conference request 318 from user device to joinor host a network conference. The request identifies the user device, aconference identifier, and a secondary device. The request may alsorequest a function to be provided remotely to the user device.

2. The server generates and transmits an initiate presence scoringcommand 320.

3. The server generates a QR code and sound signal 322 that aretransmitted to the secondary device identified by the user device in therequest. In an embodiment, the sound signal is dynamically generated orderived from the QR code.

4. The server receives the image and/or sound response 324 from the userdevice. The server also receives a resource identifier 326 thatidentifies the camera and microphone resources in use by the userdevice.

5. The server generates a presence score based on the received imageand/or sound response 324 and transmits this score to the user device.In an embodiment, if the presence score is greater than a thresholdvalue (e.g., 90%), the request 318 is granted. If the presence score isnot greater than a threshold value, the request 318 is denied.

6. The server monitors the resources in use at the user device and if achange in the resources occurs, as indicated by an updated resourceidentifier 326, the server generates an updated presence score andtransmits the updated presence score 328 to the user device. If theupdated presence score is below the threshold value, then the servicesbeing performed for the user may be terminated.

FIG. 4 shows an exemplary embodiment of the presence scoring circuit 306shown in FIG. 3. In an embodiment, the scoring circuit 306 comprises aQR code generator 402, QR matching circuit 404, sound signal generator406, sound signal matching circuit 408, and score assessment circuit410.

During operation, the QR code generator 402 generates a QR code 412. TheQR code is a type of matrix barcode (or two-dimensional barcode). Inpractice, QR codes often contain data for a locator or identifier. In anembodiment, the QR code consists of black squares arranged in a squaregrid on a white background, which can be read by an imaging device suchas a camera, and processed until the image can be appropriatelyinterpreted. The required data is then extracted from patterns that arepresent in both horizontal and vertical components of the image. In anembodiment, the generated QR code 412 contains any suitableidentification information.

The sound signal generator 406 generates a sound signal (SS) 414comprising any suitable audio pattern, tone, and/or frequency. In anembodiment, the sound signal generator 406 receives the generated QRcode 412 and uses this code to generate the sound signal 414. Thus, thesound signal is dynamically generated based on the QR code.

The QR code 412 and sound signal 414 form the transmit QR code and soundsignal 322. In an embodiment, the image and sound response 324 from auser device comprises a captured QR code 416 that is input to the QRcode matching circuit 404, and a captured sound signal 418 that is inputto the sound signal matching circuit 408. The QR code matching circuit404 matches the generated QR code 412 with the captured QR code 416 todetermine a QR matching indicator (QRMI) 420 (in the range of 0-100)that indicates how well the two codes match. The sound signal matchingcircuit 408 matches the generated sound signal 414 with the capturedsound signal 418 to determine s sound signal matching indicator (SSMI)422 (in the range of 0-100) that indicates how well the two soundsignals match.

The score assessment circuit 410 receives the QRMI 420 and the SSMI 422and determine the presence score 328. For example, in one embodiment,the circuit 410 averages the QRMI 420 and the SSMI 422 to determine thescore 328. The circuit 410 also receives the resource identifier 326 andcan use this to adjust the presence score 328. In an embodiment, theresource identifier 326 is stored in the memory 304, and when a changein the resource identifier is detected, the circuit 410 adjusts thepresence score. For example, if a less secure video resource or soundresource is identified by an updated resource identifier, then thepresence score 328 may be reduced.

FIG. 5 shows an exemplary method 500 for operating a user device toprovide embodiments of real-time presence assessment. For example, in anembodiment, the method 500 is performed by the user device 102 shown inFIG. 1 or the user device 200 shown in FIG. 2. For example, theprocessor 202 executes the presence monitoring application (PMA) 216 toperform the operations described below.

At block 502, a conference is initiated by sending a request to aserver. In an embodiment, the processor 202 of the user device 200controls the transceiver 212 to transmit the request 224 to the server104 to initiate a conference or other network function.

At block 504, an instruction to initiate presence scoring is received.For example, the user device receives the initiate presence scoringinstruction 226 from the server 104. The instruction can have anysuitable format.

At block 506, a secondary device identifier is transmitted from the userdevice. The secondary device identifier identifies a secondary device,such as a smartphone, that can be used to receive audio and videosignals for use during presence scoring.

At block 508, a QR code is received at the secondary device. Forexample, the server generates the QR code and transmits this code over anetwork, such as the cellular communication network 108, to thesmartphone 110. The received QR code is then displayed on a displayscreen of the smartphone.

At block 510, a sound signal representing a tone or other audiblesignal, is received at the secondary device. For example, the servergenerates the sound signal and transmits this sound signal over anetwork, such as the cellular communication network 108, to thesmartphone 110. The received sound signal is then reproduced by aspeaker of the smartphone to generate an audible sound. In anembodiment, the sound signal is dynamically generated based on the QRcode so that as different QR codes are generated, differentcorresponding sound signals are also generated.

At block 512, the display of the QR code on the secondary device isplaced in front of a camera on the user device so that the user devicecan capture an image of the QR code. For example, the user of the userdevice holds the smartphone up to the camera of the user device tocapture an image of the QR code displayed on the display screen of thesmartphone.

At block 514, the secondary device is placed in near of a microphone ofthe user device so that the audible sound reproduced by the speaker ofthe secondary device can be captured by the microphone of the userdevice. For example, the user of the user device holds the smartphone upto the microphone of the user device to capture a sound signalrepresenting the audible sound generated by the smartphone.

At block 516, the captured image of the QR code and the captured soundsignal are transmitted from the user device to the server. A resourceidentifier is also transmitted from the user device to the server. Forexample, the resource identifier identifies the camera and microphoneresources in use at the user device. The server uses the transmittedinformation to generate a presence score.

At block 518, the generated presence score is received at the userdevice. If the presence score is greater than a threshold value (e.g.,90%), the request transmitted at block 502 is granted. If the presencescore is not greater than the threshold value, the request is denied.Any desired threshold level can be utilized.

At block 520, assuming the request is granted, resource monitoring isperformed at the user device. For example, the processor 202 monitorsthe camera and microphone resources at the user device to determine whenany changes are made.

At block 522, the user device participates in the conference or otherrequested function.

At block 524, a determination is made as to whether a resource changehas been detected at the user device. For example, the processor 202detects when a change in the microphone or camera occurs at the userdevice. For example, a resource change occurs if a live video stream isreplaced with a replay of a stored file. If a change is detected, themethod proceeds to block 526. If no change is detected, the methodproceeds to block 522.

At block 526, an updated resource identifier is generated andtransmitted from the user device to the server. For example, the updatedresource identifier identifies video and audio resource in use at theuser device. The updated resource identifier is used to generate anupdated presence score. The method proceeds to block 518 where theupdated presence score is received at the user device.

Thus, the method 500 provides a method for operating a user device toprovide embodiments of real-time presence assessment. It should be notedthat the operations of the method 500 are exemplary and not limiting ofthe scope of the embodiments. Furthermore, the operations of the method500 can be changed, deleted, combined, rearranged, added to, orotherwise modified within the scope of the embodiments.

FIG. 6 shows an exemplary method 600 for operating a server to provideembodiments of real-time presence assessment. For example, in anembodiment, the method 600 is performed the server 104 shown in FIG. 1or by the server apparatus 300 shown in FIG. 3. For example, theprocessor 302 executes the presence assessment application (PAA) 314 toperform the operations described below.

At block 602, a request is received to participate in a conference or toperform some other function remotely. For example, the server 300receives the request 318 from a user device, such as user device 102.

At block 604, an instruction is transmitted to the requestor to initiatepresence scoring. For example, the processor 302 controls thetransceiver 310 to transmit the instruction 320 to the requestor toinitiate presence scoring. In an embodiment, the instruction 320 can bein any suitable format.

At block 606, a secondary device for the requestor is determined. Forexample, in an embodiment, the request 318 includes a requestoridentifier and a secondary device identifier. In another embodiment, therequestor identifier is used to access a database in the memory 304 thatidentifies a secondary device for that requestor.

At block 608, a QR code is generated and transmitted to the secondarydevice. In an embodiment, the processor 302 controls the presencescoring circuit 306 to generate a QR code 412 at block 402 as shown inFIG. 4. The generated QR code is transmitted to the secondary device aspart of signal 322.

At block 610, a sound signal is generated and transmitted to thesecondary device. In an embodiment, the processor 302 controls thepresence scoring circuit 306 to generate a sound signal 414 at block 406as shown in FIG. 4. The generated sound signal is transmitted to thesecondary device as part of the transmitted signal 322. In anembodiment, the sound signal is dynamically generated based on thegenerated QR code so that the generated sound signal changes as new QRcodes are generated.

At block 612, a captured image of the transmitted QR code is receivedfrom the requestor. For example, the user device 102 captures the imageof the QR code from the display screen of the secondary device andtransmits this captured image to the server. For example, the server 300receives the captures image as part of the received signal 324.

At block 614, a captured sound clip of the transmitted sound signal isreceived from the requestor. For example, the user device 102 capturesthe sound clip of the sound signal as it is reproduced by a speaker ofthe secondary device. The user device 102 transmits this captured soundclip to the server. For example, the server 300 receives the capturessound clip as part of the received signal 324.

At block 616, a resource identifier (RI) is received from the requestor.For example, the resource identifier identifies the camera andmicrophone resources in use at the user device. The server receives theresource identifier 326 and uses this information to generate a presencescore.

At block 618, a presence score is generated for the requesting device.In an embodiment, the presence scoring circuit 306 generates thepresence score. For example, the received captured QR code and soundsignal are matched to their transmitted versions by matching circuits404 and 408. The score assessment circuit 410 determines how closely thesignals match and generates the presence score 328.

At block 620, the presence score is output. For example, the processor302 controls the transceiver 310 to transmit the presence score 328 tothe requesting device. If the presence score is greater than a thresholdvalue (e.g., 90%), the request received at block 602 is granted. If thepresence score is not greater than the threshold value, the request isdenied. Any desired threshold level can be utilized. The processor 302makes this determination and informs the requestor of the decision withthe transmitted presence score.

At block 622, assuming the presence score exceeds the threshold value, adetermination is made as to whether an updated resource identifier hasbeen received. For example, the processor 202 detects when an updatedresource identifier 326 is received. The updated resource identifierindicates a change in resources, such as a change in the microphone orcamera at the user device. If an updated resource identifier isdetected, the method proceeds to block 618 where an updated presencescore is determined. If an updated resource identifier is not detected,the method proceeds to block 622.

Thus, the method 600 provides a method for operating a server to provideembodiments of real-time presence assessment. It should be noted thatthe operations of the method 600 are exemplary and not limiting of thescope of the embodiments. Furthermore the operations of the method 600can be changed, deleted, combined, rearranged, added to, or otherwisemodified within the scope of the embodiments.

FIG. 7 shows an alternative embodiment for using a secondary device toperform real-time presence assessment. Instead of sending a QR code tothe secondary device, in this embodiment, a video challenge is sent tothe secondary device. In an embodiment, the user of the secondary devicesolves a generated Augmented Reality (AR) CAPTCHA (completely automatedpublic Turing to tell computers and humans apart) to prove theirpresence. For example, as illustrated in FIG. 7, an AR CAPTCHA 702 issent to and displayed on a secondary device 700. For example, theCAPTCHA 702 is sent from the server to the secondary device at block608. The CAPTCHA 702 comprises a variety of characters and symbols. Asthe device 700 is rotated by the user, as indicated at 704 for example,a code word appears. In this example, the code word “TREE” 706 appears.The user then enters this code word at a user device and it istransmitted back to the server, for instance, at block 516. The returnedcode word is used at the server to generate the presence score.

In an alternative embodiment, video challenges are used to detectpresence. The user of the user device solves puzzles that are presentedeither on the user device or on the secondary device. For example, thevideo challenge may require that the user slide a virtual toggle withhis/her hands, following a ball that rolls across the bottom of adisplay screen with his/her eyes, or tag shapes of a specific colors. Invarious embodiment, these video puzzles are solved either on the userdevice or on the secondary device. The results are transmitted back tothe server, where the presence score is generated.

FIG. 8 shows an exemplary method 800 for operating a server to provideembodiments of real-time presence assessment. For example, in anembodiment, the method 800 is performed the server 104 shown in FIG. 1or by the server apparatus 300 shown in FIG. 3. For example, theprocessor 302 executes the presence assessment application (PAA) 314 toperform the operations described below. The method 800 is similar to themethod 600 but utilizes a video challenge instead of a QR code. Forexample, the presence scoring circuit 306 generates the video challengeat block 402 instead of the QR code, and the returned code is comparedto the challenge code at block 404 to generate the matching indicator420.

At block 608 a, the server transmits the video challenge to either theuser device or the secondary device. For example, block 608 a replacesblock 608 in the method 600. In an embodiment, the server transmits anAR CAPTCHA to the secondary device. The user rotates the secondarydevice to reveal a code that is transmitted back to the server.

At block 612 a, the server receives a response to the video challengefrom either the user device or the secondary device. For example, block612 a replaces block 612 in the method 600. In an embodiment, the serverreceives the code embedded in an AR CAPTCHA from the secondary device.The code is then used to generate the presence score.

Thus, the method 800 provides a method for operating a server to provideembodiments of real-time presence assessment. It should be noted thatthe operations of the method 800 are exemplary and not limiting of thescope of the embodiments. Furthermore the operations of the method 800can be changed, deleted, combined, rearranged, added to, or otherwisemodified within the scope of the embodiments.

FIG. 9 shows an exemplary method 900 for operating a user device toprovide embodiments of real-time presence assessment. For example, in anembodiment, the method 900 is performed by the user device 102 shown inFIG. 1 or by the user device 200 shown in FIG. 2. For example, theprocessor 202 executes the presence monitoring application (PMA) 216 toperform the operations described below. The method 900 is similar to themethod 500 but utilizes a video challenge instead of a QR code. Forexample, the presence scoring circuit 306 generates the video challengeat block 402 instead of the QR code, and the returned code is comparedto the challenge code at block 404 to generate the matching indicator420.

At block 508 a, the secondary device associated with the user devicereceives a video challenge from the server. For example, block 508 areplaces block 508 in the method 500. In an embodiment, the secondarydevice receives an AR CAPTCHA from the server.

At block 512 a, the user rotates the secondary device to reveal a codein the display of the AR CAPTCHA. For example, block 512 a replacesblock 512 in the method 500.

At block 516 a, the code is transmitted back to the server. For example,block 516 a replaces block 516 in the method 500. The user enters therevealed code into the user device, which transmits the code to theserver. The code is then used to generate the presence score.

Thus, the method 900 provides a method for operating a user device toprovide embodiments of real-time presence assessment. It should be notedthat the operations of the method 900 are exemplary and not limiting ofthe scope of the embodiments. Furthermore the operations of the method900 can be changed, deleted, combined, rearranged, added to, orotherwise modified within the scope of the embodiments.

In an embodiment, the exemplary embodiments described herein areimplemented using customized hard-wired logic, one or more ASICs orFPGAs, firmware and/or program logic which in combination with acomputer system causes or programs the disclosed apparatus to be aspecial-purpose machine. According to one embodiment, the operationsdescribed herein are performed by a processor or computer executing oneor more sequences of one or more instructions contained in memory. Suchinstructions may be read into memory from another storage medium.Execution of the sequences of instructions contained in memory causes aprocessor to perform the process steps described herein. In alternativeembodiments, hard-wired circuitry may be used in place of or incombination with software instructions.

The term “storage media” as used herein refers to any non-transitorymedium that stores data and/or instructions that cause a machine tooperate in a specific fashion. Such storage media may comprisenon-volatile media and/or volatile media. Non-volatile media includes,for example, optical or magnetic disks, such as memory 304 orinstructions memory 308. Volatile media includes dynamic memory. Commonforms of storage media include, for example, a floppy disk, a flexibledisk, a hard disk, a solid state drive, a magnetic tape, or any othermagnetic data storage medium, a CD-ROM, any other optical data storagemedium, any physical medium with patterns of holes, a RAM, a PROM, andan EPROM, a FLASH-EPROM, an NVRAM, any other memory chip or cartridge.

Storage media is distinct from but may be used in conjunction withtransmission media. Transmission media participates in transferringinformation between storage media. For example, transmission mediaincludes coaxial cables, copper wire, and fiber optics, including thewires that comprise one or more buses. Transmission media can also takethe form of acoustic or light waves, such as those generated duringradio-wave and infra-red data communications.

Various forms of media may be involved in carrying one or more sequencesof one or more instructions to a disclosed processor for execution. Forexample, the instructions may initially be carried on a magnetic disk ora solid-state drive of a remote computer. The remote computer can loadthe instructions into its dynamic memory and send the instructions overa telephone line using a modem. A local modem can receive the data onthe telephone line and use an infra-red transmitter to convert the datato an infra-red signal. An infra-red detector can receive the datacarried in the infra-red signal and appropriate circuitry can place thedata on a data bus, which carries the data to a memory, from which aprocessor retrieves and executes the instructions. The instructions mayoptionally be stored on a storage device either before or afterexecution by processor.

The exemplary embodiment of the present invention includes variousprocessing steps described herein. The steps of the embodiment may beembodied in machine or computer executable instructions. Theinstructions can be used to cause a general purpose or special purposesystem, which is programmed with the instructions, to perform the stepsof the exemplary embodiment of the present invention. Alternatively, thesteps of the exemplary embodiment of the present invention may beperformed by specific hardware components that contain hard-wired logicfor performing the steps, or by any combination of programmed computercomponents and custom hardware components.

While particular embodiments of the present invention have been shownand described, it will be obvious to those of ordinary skills in the artthat based upon the teachings herein, changes and modifications may bemade without departing from these exemplary embodiments of the presentinvention and its broader aspects. Therefore, the appended claims areintended to encompass within their scope all such changes andmodifications as are within the true spirit and scope of this exemplaryembodiments of the present invention.

What is claimed is:
 1. A method for determining a presence score, themethod comprising: transmitting, to a secondary device, a quick response(QR) code and a sound signal; receiving, from a user device in proximityto the secondary device, an image of the QR code and a sound clip of thesound signal, the QR code and the sound signal being reproduced at thesecondary device and captured to the image and the sound clip at theuser device; determining a first matching indicator between the QR codeand the image of the QR code; determining a second matching indicatorbetween the captured sound clip and the generated sound signal; andgenerating a presence score associated with the user device based on thefirst matching indicator and the second matching indicator.
 2. Themethod of claim 1, wherein the transmitting and the receiving areperformed over at least one of a wired network and a wireless network.3. The method of claim 1, further comprising transmitting a request tothe user device to initiate presence scoring.
 4. The method of claim 1,further comprising transmitting the presence score to the user device.5. The method of claim 1, further comprising receiving a resourceidentifier that identifies resources at the user device.
 6. The methodof claim 5, further comprising receiving an updated resource identifierthat identifies a change to the resources at the user device.
 7. Themethod of claim 6, further comprising determining an updated presencescore based on the updated resource identifier.
 8. The method of claim7, further comprising transmitting the updated presence score to theuser device.
 9. The method of claim 1, wherein the secondary device isassociated with the user device.
 10. An apparatus for determining apresence score, the apparatus comprising: a transceiver configured totransmit a quick response (QR) code and a sound signal; a user deviceconfigured to receive an image of the QR code and a sound clip of thesound signal; a secondary device configured to receive the QR code andthe sound signal, and reproduce the QR code and the sound signal inproximity to the user device; and a processor configured to determine afirst matching indicator between the QR code and the image of the QRcode, determine a second matching indicator between the captured soundclip and the generated sound signal, and generate a presence scoreassociated with the user device based on the first matching indicatorand the second matching indicator.
 11. The apparatus of claim 10,wherein the transceiver is configured to transmit and receive over atleast one of a wired network and a wireless network.
 12. The apparatusof claim 10, wherein the transceiver transmits a request to the userdevice to initiate presence scoring.
 13. The apparatus of claim 10,wherein the transceiver transmits the presence score to the user device.14. The apparatus of claim 10, wherein the transceiver receives aresource identifier that identifies resources the user device.
 15. Theapparatus of claim 14, wherein the transceiver receives an updatedresource identifier that identifies a change to the resources at theuser device.
 16. The apparatus of claim 15, wherein the processordetermines an updated presence score based on the updated resourceidentifier.
 17. The apparatus of claim 16, wherein the transceivertransmits the updated presence score to the user device.
 18. Theapparatus of claim 10, wherein the secondary device is associated withthe user device.
 19. A non-transitory computer readable medium on whichare stored program instructions that, when executed by one or moreprocessors, cause the one or more processors to determine a presencescore by performing operations of: transmitting, to a secondary device,a quick response (QR) code and a sound signal; receiving, from a userdevice in proximity to the secondary device, an image of the QR code anda sound clip of the sound signal, the QR code and the sound signal beingreproduced at the secondary device and captured to the image and thesound clip at the user device; determining a first matching indicatorbetween the QR code and the image of the QR code; determining a secondmatching indicator between the captured sound clip and the generatedsound signal; and generating a presence score associated with the userdevice based on the first matching indicator and the second matchingindicator.
 20. The non-transitory computer readable medium of claim 19,wherein the instructions cause the one or more processors to performoperations of: receiving an updated resource identifier that identifiesa change to resources in use at the user device; and determining anupdated score based on the updated resource identifier.